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(57) Abstract 

A watermark embedded in an information signal is detected by correlating said information signal with a plurality of watemfiarks 
W/n). The respective amounts of correlation C(iJ) are then evaluated to determine the watermark embedded in the signal Xi(n). The 
invention provides a significant improvement of the detection by predictive filtering (25) the information signal and/or predictive filtering 
(26) the applied watermark prior to the process of conelaling the signals. 
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Detecting a watennark embedded in an infonnation signal. 



The invention relates to a method of detecting a wat^mark onbedded in 
an informatim signal, conqmsing a ccnelation stq> for correlating said signal and an ^lied 
watermark, and an evaluaticm siep for evaluating die result of said correlation. The inventicm 
also relates to a method for carrying out said method. 

5 

Watennarks are perceptually invisible messages embedded in multimedia 
content such as audio, still images, animations or video. They comprise information, for 
exanq>le, about tfie source or copy right status of documents or audiovisual programs. 
Watermarks can be used to provide legal proof of the own^ of the copyright. They allow 

10 tradng of piracy and support the protection of intellectual property. 

A known m^hod of detecting a watmnark mibedded in an infonnation 
signal ccmiprises a correlation stq> fw correlating said signal and an applied watermark. The 
result of said correlation is then evaluated. For example, if the amount of correlation is 
larger than a predetwmined value, the s^iplied watermark may be considered to be the 

15 watermark embedded in the signal. Alternatively, a number of successive correlation steps 
can be carried out for different appUed watermarks. The appUed watermark yielding the 
largest correlation is then ccmsidered to be the watmnark embedded in ttie signal. 

OBJECT AND SUMMARY OF THE INVENTION 
20 It is an object of the invention, inter alia, to provide a m^hod with whidi 

an embedded wat^mark can yet mcHe reliably be detected. 

To that end, the m^hod is diaractmzed by the steps of predictive 

filtering tte infc^mation ^gnal or the applied watennark or both, and flying the 

corrdation step to said filtered signal and said filtered watermark. 
25 The inventicm is based on the recognition that the problem of detecting 

watennarks closely resembles the detecticm of weak radio or radar signals in the presmcc of 

strong interference or noise. By predictive filtering, i.e. subtracting a prediction of the 

information signal from said signal, a readual signal is obtained having a significant lower 
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variance. This means that the interference which the watermark suffers from the residual 
information is considerably less than it suffers from the original signal. 

These and other aspects of the invention will be apparent from and 
elucidated with reference to the embodiments described hereinafter. 

Fig. 1 shows schematically an arrangement for watermarking a video 

signal. 

Fig.2 shows schematically a prior art arrangement for detecting a 
watermark embedded in the signal which is genwated by the arrangement shown in Fig.l. 

Figs. 3 and 4 show schematically arrangements for detecting the water- 
mark in accordance with the invention. 

The invention will herein be described by way of an example of detecting 
a watermark which is embedded in a digital video signal. The watermarks can be added in 
almost ev^ domain such as, for example, the time domain, the spatial domain, the 
transform domain after DCT or Fourier transform, etc. In the present example, it is 
embedded in the spatial domain, i.e. it is added to the luminance pixel values of a digital 
video signal. 

Fig.l shows schematically an arrangement 1 for watermarking the video 
signal. The arrangement receives a video signal in the form of luminance samples or pixels 
p(n) and a watermark W^. The watermark can be a code which uniquely identifies the owner 
of the copyright. It can also be a text string or simply a binary coded number. Accordingly, 

is a finite set of different watermarks W^. The arrangement comprises a watermark data 
signal gwierator 11 which generates a predetermined watermark data signal wjCn) for each 
watermark Wj. The luminance value p(n) and watermark data value Wi(n) are added by an 
adder 12 pixel-by-pixel. Accordingly, the output signal x^(n) of the watermarking circuit 1 is: 

Xi(n) = pin) +i/j(j3> 

The watermark data signal Wi(n) is chosen such that it is perceptually 
invisible when the output signal is displayed on a receiver. For example, a small value is 
added to the luminance of selected pixels p(n) of the video image, the watermark 
determining the selected pixels. An example hereof will now be given in terms of an image 
of 8 pixels horizontally and 4 pixels vertically. It is to be noted that the method can also be 
applied to a predetermined part of the image. The method can also be applied to a plurality 
of image blocks, each block being associated with a portion of the watermark. 

CONRRMAnON COPY 
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- In thcprcsent exampte, the value l is added to^^^^ 

pixds whereas other pixels remain unaffected. The foUowing equation denotes a watermark 
data agnal Wi(n) that is generated by watermark data signal generator 11 in reqx>nse to a 
first watennark W,: 

01010101 
10101010 
'^^^^^ ^01010101 
10101010 



Tlie following equation denc^ a watermaric data signal w^n) that is generated by the 
watermark data signal generator if a seccmd watermark is applied: 



00110011 
11001100 
00110011 
11001100 



In this manner, the watermark data signal generator 11 generates a different watermark data 
10 signal Wi(n) for each watermark W;. 

In the present examfde, the video image is assumed to rq>resent a vertical 
transition from a luminance value 10 to a luminance value 80, The range of luminance values 
p(n) is assumed to be 0-255* In mathematical notation: 

10 10 10 10 80 80 80 80 

10 10 10 10 80 80 80 80 

^^^^ 10 10 10 10 80 80 80 80 

10 10 10 10 80 80 80 80 



15 Accordingly, if watermark Wj is 2^1ied to arrangement 1, the watermark 

data signal Wi(n) is added to image signal p(n), which results in the foUowing output signal 
X|(n): 



10 11 10 11 80 81 80 81 

11 10 11 10 81 80 81 80 

10 11 10 11 80 81 80 81 

11 10 11 10 81 80 81 80 
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Similaflyrif watemuli: is qyplied fo the anangenienC the wsU^^ 

signal W2(n) is added to image signal p(n), which results in the following output signal XjCn): 

10 10 11 11 80 80 81 81 

11 11 10 10 81 81 80 80 
^ 10 10 11 11 80 80 81 81 

11 11 10 10 81 81 80 80 



It will be appreciated that ndther the diffeience between an output signal Xi(n) and input 
5 signal p(n)» nor the difference b^ween output signals X|(n) and XjCn)^ is perceivable for a 
human visual system. The ou^t signal X|(n) is stored on a storage medium such as an 
optical disc or a magn^c tape, or transmitted through a transmis^cm channel (not ^wn in 
Fig.l). 

Fig.2 shows schematically a prior art arrangemmt 2 for detecting the 
10 waterman Wj embedded in the signal x^Cn). The arrangement receives a watennarlc Wj and 
ddiveis an indication of whether or not the zpphod watermark Wj resembles the mibedded 
watermark W|, i.e. whether i==j ex* noL The arrangement comprises a watermark data signal 
generates 21 wfaidi is identical to, and produces die same watermark data signal Wj(n) as the 
watmnark data signal generator 11 which is shown in Fig.L The input signal Xj(n) and the 
IS watermark data signal Wj(n) are s^lied to a circuit which is often referred to as a matched 
filt^ or correlator* In the embodiment shown in Fig.2, said correlator ccHnprises a, multiplier 

22 and a summation circuit 23. The correlator performs the f(rilowing mathematical 
operation: 

Cii.j) = 5^x^{jj)*iir,(n) 
ii-i 

20 in which N denotes the total number of pixds. It will be a^ypredated that, if the information 
signal is an analog agnal, for example a time continuous signal x(t), the summation circuit 

23 will be an int^rator. 

Tlie correlator ou^ut is a number CO J) which iq[xresents an amount of 
correlaticm between the input ^nal x^Cn) and the wat^mark data signal w/n). In an 
25 evaluation circuit 24, the value C(i J) is evaluated for various watermarks Wj. The watermark 
Wj yidding the highest correlation is ttien assumed to be the watermark W^. Only two 
different watermarks are considered here. 
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' " " The conaadbn C(i j) can' casUy be calculated. If watexmafk Wi is 
embedded in the signal, the cocrelaticm between Xi(n) and Wi(n) appears to be C(l,l)-736 
whereas the ccxrrdation between Xi(n) and w^n) appears to be C(l,2)=728. Because C(l,l) 
is greater than C(l,2), the evaluation circuit 24 determines that the embedded watermark is 
S Wj. If watermark is embedded, the correlation between XjCn) and Wi(n) i^ypears to be 
C(2,l)=728 whwcas the corrdatiOT between x^n) and W2(n) appears to be C(2,2)=736. 
Because C(2,2) is greater than C(2,l), the evaluaticm circuit 24 determines that the embedded 
wat^mark is W}. Hie following Table I summarizes the above results. The rows of this 
Table denote input signal Xi(n), i.e. the input signal in which a watennark W| is embedded. 
10 The columns denote watermark Wj which is implied to arrangement 2. 





w, 


Wa 


x,(n) 


C(l,l)=736 


C(l,2)=728 


Xj(ll) 


C(2,l)=728 


C(2,2)=736 



IS It will be ^ypredated from this example that the values of C(i J) 

rq>resenting the amounts of ccvrelation are close to each other. This means that the detection 
circuit is vulnerable with respect to ncnse, transmissicm errors, coding errors, etc. 

Fig. 3 shows schematically an arrangement 3 for detecting the wat^mark 
Wi embedded in the signal x^Cn) in accordance with the invention. The arrangement ' 

20 comprises ttie same watermark data signal generator 21, multipli^ 22, summation circuit 23 
and evaluation circuit 24 as are shown in Fig.2. The arrangement further comprises a first 
predictive filter 25 and a second predictive filter 26. The first predictive filter 25 is 
connected betwem the signal inimt and the multiplier 22. It filtm the input signal Xj(n) and 
generates a filtered input ^gnal X|*(n). Ihe pre filtering process is also called "whit»ing", 

25 similar to filters that decorrdate noise in ladar and radio communication receivers. 

The second predictive filter 26 is connected between the watermark data 
signal generate 21 and the multiplier 22. It Glten the locally applied watermaric data signal 
wj(n) and generates a filtered watermaric data signal Wj*(n). The structure of each predictive 
filter is based on statistical properties of the information signal. Such filters are known per se 

30 in the field of source coding. Examples are linear predictive filters as used in DPCM image 
and speech coding. Other examples are combinations of a transform, a prediction for each 
frequency subband or transform coefficient, and an inverse transform. 
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In the presmf titaunple; in which tte input signal is a digital video image, 
pmfictive filter 25 predicts each pixel from its neighbours to the left, to the right, above and 
below. The predicted value is then subtracted from the actual pixel value to obtain a residual 
value. In mathematical notation: 

A 

in which u en v denote discr^ pixel positions alcmg the horizontal (u) and vertical (v) axes, 
y(u,v) denotes filter input samples and y'(u,v) denotes filter ou^t samples. Accordingly, the 
following equaticMis aqpply to the filtered input signal x/(n) and the filtered input signal 
X2*(n)> req)ecdvely (a scaling factor 4 has been ^lied to maintain integer values): 



10 jciin) = 



18 14 7 -56 147 84 77 164 

14 -4 4 -74 74 -4 4 77 

7 4 -4 -66 66 4 -4 84 

24 7 14 -63 154 77 84 158 



xUn) 



19 8 13 -57 148 78 83 163 

13 3 -3 -73 73 3 -3 78 

8 -3 3 -67 67 -3 3 83 

23 13 8 -62 153 83 78 159 



Furth^, ttie first predictive filter 25 and the second predictive filter 26 are 
the same in this example. Although this is a preferred embodimoit which yields the best 
performance, it is not essential. The filters may be different, or one of the predictive filters 
15 25 and 26 may even be dispensed with. The p^ormance of the watermark d^ecting 

arrangement is then still significantly better than the perfonoanoe of the prior art arrangement. 
Accordingly, the following equaticms s^Iy to the filtered watermark data signal W|*(n) and 
the filtered watermark data signal Wj'Cn), respectively: 
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-2 


3 


3-' 


-2" 


-2 




3 


3 


3 


-3 


-3 


3 


3 


-3 


-2 


-2 


-3 


3 


3 


-3 


-3 


3 


3 


3 


3 


-2 


-2 


3 


3 


-2 


-1 



10 



15 



The following Table n shows the amounts of correlation C(i J) between filtered input signal 
Xi*(n) and filteied watermark data signal w/(n) a»ieqx)nding with watomark Wj. It will be 
i^imdated from conqniistxi with Table I that the performance of the watermark detected 
shown in Fig.3 is significantly bett» than the one shown in Fig.2. 



20 









x,'(n) 


C(l,l)=1152 


C(l,2)=704 


x,'(n) 


Cai)=704 


C(2,2)=952 



Table m shows the amounts of correlation between filtoed input signal 
Xi'(n) and the unfiltered watermark data signal W|(n), i.e. if the input signal x^{n) is subjected 
to predictive filtmng cmly. The watermark data agnal w/n) is direcUy applied to the 
multq>Iier 22 in this case. As can be seen, die p^forraance is worse than in Table n but still 
better than in Table 1. 







Wj 


xr(n) 


C(l.l)=604 


C(l,2)=544 


x,'(n) 


C(2,l)»544 


C(2,2)=588 



Table IV shows the amounts of corrdation between the unfiltered input 
signal Xi(n) and the filtered watmoark data signal Wj'(n), i.e. if the watermark data signal 
w/n) is subjected to predictive filtering only. Tlie input signal Xi(n) is direcfly applied to the. 
multq>lier 22 in this case. Again, the performance is wwse than in Table n but still better 
than in Table 1. 
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x,(n) 


C(l,l)=604 


C(l,2)=544 


Xj(ll) 


C(2,l)=544 


C(2,2)=588 



5 Fig.4 shows a further embodiment of an arrangement 4 for detecting the 

embedded watermark. In this anangraient, eadi pixel of the input signal X|(n) is multiplied in 
a multq>Iier 42 by a spedfic weighting fiictw. The products are summed in a aimmation 
dicuit 43 which delivers the cc»relatum value C(tJ). A calculating circuit 44 receives the 
applied watermark Wj and generates the weighting bcuxs using a model of the statistical 

10 pn^ierties of the information signal* In this embodiment, predictive filtering is not ^lied to 
tiie input signal but raibedded in Ae calculation circuit 44. 

In sununary, a watermark embedded in an information signal is detected 
by correlating said information signal widi a plurality of watermarks Wj(n). The req)ective 
amounts of correlaticMi C^) are then evaluated to determine the watermark embedded in the 

IS agnal Xj(n). The inventioo provides a significant in^novement of the detection by predictive 
filtering (25) the infbrmaticm signal and/or imdictive filtering (26) the applied watermark 
prior to the process of conelating the signals. 
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Claims 



I A method of detecting a watennark embedded in an information signal, 

conqninng a condation step far conelating said signal and an ^lied watermark, and an 
evaluatim step for evaluating the result of said correlati<m, characterized by the stq»s of 
predictive ffltering the information signal or the appUed watermark or both, and applying the 
5 coixelatiiMi step to said filtered ngnal and said filtered watmnark. 

2, The method as claimed in daim 1, wherdn the predictive filtering is 

adapted to predetermined statistical properties of the information signal. 

3^ The method as claimed in daim 1, wherein both predictive filter st^s are 

the same. 

10 4 >v method of detecting a watermark embedded in an inf(»mation signal, 

comprising the step of filtering said signal using filter coeffidents determined by an appUed 
watermark, and evaluating die result of said filtering, characterized in that the filter 
coefficients are further determined by a modd of the statistical properties of the information 
agnal. 

15 5. An arrangement for detecting a watermark (Wj) embedded in an 

information signal, comprising correlation means (22,23) for conelating said signal (x) and 
an applied watermark (Wj), and evaluation means (24) for evaluating the result of said 
condation, characterized by a predictive filter (25) for filtering the information signal or a 
predictive filter (26) to filter the apflOei watermark, or both predictive filters, and applying 

20 filtoed signal and the filtered watennark to tfie ondation means. 

6. TTic arrangement as claimed in claim 4, whoein the predictive filters 
(25,2£) are adapted to i»edetermined statistical propoties of the information signal. 

7. The arrangement as daimed in daim 5, whodn both predictive filters 
(25,26) are the same. 

25 8. An arrangement f« detecting a watermark (W|) embedded in an 

information signal Q, comprising a filter (41,42,43) for filtering said signal using filter 
coefficients, calcuh»tion means (44) for calculating said filter coeffidents in dependence on 
an applied watennark (Wj), and means (24) for evaluating the result of said filtering, 
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characterized in that the calculation means (44) are adapted to further determine the' filter - 
coefficients in accordance with a model of the statistical properties of the information signal. 
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